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Abstract 

We report an application of a simultaneous perturbation stochastic approximation (SPSA) algo- 
rithm to filtering systematic noise (SN) with non-zero mean value in photoemission data. In our 
analysis we have used a series of 50 single-scan photoemission spectra of W(llO) surface where 
randomly chosen SN was added. It was found that the SPSA-evaluated spectrum is in good agree- 
ment with the spectrum measured without SN. On the basis of our results a wide application of 
SPSA for evaluation of experimental data is anticipated. 
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Very often measurements of physical quantities are considerably hindered by observation 
of noises of unknown nature. This problem appears in many industrial as well as scientific 
applications, such as pattern recognition, product quality improvement, control of heavy ion 
beams, probing of electronic structure of solids and molecules by spectroscopic techniques, 
etc. Traditionally, experimental noises of different origins are assumed to be independent 
from each other and characterized by zero-mean values. These assumptions are frequently 
hard to justify. But without them, the validity of many algorithms is questionable in applica- 
tions. For example, it is known that the standard "least-squares method" or the "maximum 
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likelihood method" p| give wrong estimates if the observed noise has an "unknown-but- 
bounded" deterministic nature or it is a "dependent" sequence from probabilistic point of 
view. 

Let us consider photoemission (PE) measurement where systematic noise (SN) of 

unknown origin appears at some particular kinetic energies of photoelectrons. Such noise 
may introduce additional spectral features that can not be expected from electronic structure 
of sample. If this noise is not zero-mean it cannot be eliminated by simple increase of number 
of scans in PE experiment. One of the effective ways to deal with such noise is using of new 
mathematic algorithms. 

Mathematical algorithms for search and optimization play a severe role in finding best 
options to solve many problems not only in physics, but in engineering, business, medicine, 
as well as in other natural and social sciences. In the case of prior information ambiguity, 
recursive algorithms are most effective among many other approaches. Such algorithms start 
with an initial "guess" of a solution, and this assessment is updated on an iteration basis 
with the purpose of improving the measured (observable) objective function of sample. In 
most practical problems, the relevant solution depends on more than one quantity, leading 
to multivariate optimization problem of minimizing or maximizing the objective function 
dependent on multiple variables. There is much interest in recursive optimization algorithms 
that rely on direct measurements of the objective function only, not direct probing of its gra- 
dient. Such algorithms have the advantage of not requiring detailed modeling information 
describing links between parameters to be optimized and the objective function. Many sys- 
tems involving human beings or computer simulations that are difficult to treat analytically, 
could potentially benefit from applications of this kind of optimization approaches. 

One particular optimization algorithm that has attracted considerable international at- 
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tention in the recent past is the simultaneous perturbation stochastic approximation (SPSA) 
method (see for review 0, [s]). Likewise simulated annealing or genetic algorithms, SPSA 
uses only objective function measurements, that is of decisive importance in experiments 
where direct probing of the gradient of the objective function is rather difficult or not pos- 
sible at all. In difference to other methods, SPSA is especially efficient to high-dimensional 
problems in terms of providing a good solution for a relatively small number of measurements 
of the objective function. Recently this algorithm was successfully applied to a number of 
tasks like queuing systems [gI] or control of heavy ion beams j?! . 

In the present study we demonstrate for the first time application of a SPSA algorithm 
for analysis of PE spectra, which include a noise with non-zero mean value. PE spectra of 
W(llO) surface were collected upon excitation with two independent photon sources, one of 
which was used as a probe and second one as a source of the noise. It was shown that the 
spectrum obtained after application of the SPSA algorithm to a series of fifty PE single-scan 
spectra is in good agreement with the spectrum measured without SN. On the basis of these 
results we conclude that exploiting of SPSA can be useful for analysis of any experimental 
spectroscopic data. We can expect a wide application of this method for filtering systematic 
noises that can appear in many kinds of measurements or experiments. 

Photoemission spectra 2j, [3(] were taken from a W(llO) single crystal kept at room tem- 
perature. Experiments were performed in the setup based on the hemispherical energy 
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analyzer (SPECS PHOIBOS 150) [8]. The overall-system energy resolution accounting for 
the thermal broadening was set to 150 meV and electrons were collected in angle-integrated 
mode around the surface normal. The base pressure was in the range of 1 x 10^^° mbar. Prior 
to experiment, the W(llO) crystal was carefully cleaned by repeated cycles of heating up to 
1300° C in oxygen ambient pressure of 5 x 10~^ mbar for 15 min each and subsequent fiashing 
up to 2300° C. After such procedure the crystal was kept in vacuum for 24 hours in order 
to passivate the surface of the crystal via absorption of residual gases in the experimental 
chamber. This step was necessary in order to stabilize the crystal surface in the long-term 
surface-sensitive PE experiment. As an excitation light sources we have used Hella reso- 
nance line [hu = 40.8 eV) and Al Ka emission line {hu = 1486.6 eV) in order to generate 
studied PE signal (objective function) and independent non-zero mean noise, respectively. 
The scheme of the experiment is shown in Fig. 1(a). PE spectra were collected in the 
range of 25.8 — 37.8 eV kinetic energies of emitted photoelectrons. In this case, the Hella 
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radiation of fixed intensity was used to produce each time single-scan PE spectrum of the 
valence band of W(llO) surface (Fig. 2, open circles). Thereby different single-scan spectra 
were excited with different Hella radiation intensities which were randomly selected. The 
photocurrent emitted in this process can be expressed as 

j{Ekir^) = I ■ DOS{Ekin) ' da{Eun) I dQ, (1) 

where / is the intensity of the fight source (Hello;), DOS denotes the electronic density of 
states of the W(llO) surface, da{Ekin)/dQ is the cross-section of the photoemission process, 
Ekin = hu — W — Eb stands for the kinetic energy of the photoelectron (VF— work function 

of the material, i^^— binding energy of the electron in the solid). Since da{Ekin) / dQ is 
practically constant in the small energy range, the total photocurrent can be written as 

J (Ekin) = I ■ const ■ DOS {Ekin) ■ (2) 

It is proportional to density of states and to intensity of incoming radiation. 

In every single-scan experiment the systematic noise N{Ekin) was introduced by 
switching-on the x-ray source when measuring in the range of 28.8 — 35.9 eV kinetic en- 
ergies (shaded area in the bottom of Fig. 2). A resulted single-scan spectrum in this energy 
region is shown by filled circles in Fig. 2. In such way generated noise represents secondary 
electrons in the x-ray spectrum of the W(llO) surface. We emphasize that this source of 
electrons is independent from the first one caused by the He Ho; radiation. 

From this consideration we can rewrite the total photocurrent in the following form: 

j{Ekin) = I ■ const ■ DOS(Ekin) + N(Ekin) . (3) 
For a series of measurements, the previous expression can be rewritten as 

Jn = In- On + Nn,n= 1,2,..., (4) 

where n is an iteration number. Observable (strictly measured) variables jn and /„ corre- 
spond to j{Ekin) and /, while unobservable investigated variable 9n and systematic noise 
Nn correspond to const ■ DOS{Ef;in) and N{Ekin), respectively. Depending on even slight 
changes of the experimental conditions (like temperature drift, etc.) from one measurement 
to another, the investigated const ■ DOS{Ekin) parameter can randomly vary within a cer- 
tain distribution function around a fixed mean value. The goal of the whole measurement 
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process is to probe this mean value. For each experiment we can consider unknown 6.^ values 
to be randomly distributed: 

en = e + Wn,n = 1,2,..., (5) 

where 6 is the investigated mean value and Wn is a random zero-mean disturbance. 

If Nn from Eq. (4) represents a systematic noise with a non-zero mean value, convention- 
ally used algorithms are failed to correctly estimate 6. To account for the non-zero mean 
contribution of SN to the estimated mean value of the investigated parameter jol, in the 
present experiment randomly distributed /„ were generated (see above). 

Let us assume, the observable variable J„ is randomly distributed around its known 
mean value /. Note, there is no correlations between and Nn that is of high importance 
for consistency of the proposed in the following algorithm. The latter is always true, if 
/„ is selected to be random, while I^L is unknown, but bounded deterministic function. 
Main issue of the suggested in Ref. |9| algorithm is to estimate mean value 9 of [const ■ 
DOS{Ekin)] measuring j„ (experimental spectra) for randomly distributed J„ (intensity of 
Hella radiation). Intuitively, the underlying mathematics can be understood on the basis 
of Equation (4), which can be partially differentiated with respect to variable J„. In case 
and Nn are independent from each other, a partial derivative of j„ is equal to On- 

Based on the above, the task of eliminating the systematic noise is reformulated to con- 
struct a sequence of estimations of average value of parameter of the linear regression model. 
It was shown [9] that in this case one can effectively use a SPSA type algorithm or random- 
ized least-square method. 

In order to evaluate the experimental data we applied a modification of the SPSA al- 
gorithm which is described in Ref. [sl [see Fig. 1(b) for the scheme of SPSA application]. 
Everywhere in the following we use On instead of On to emphasize that the estimated, not 
real, values of the investigated variable are considered 

On = On-l - -^{InOn-l - jn) , n = 1, 2 ,...,% = 0, (6) 

where A„ = In — I and is positive bounded dispersion of A„. 

If the estimation sequence |^n| leads to some particular value i9 > we can assert that 
this final approximate result equals to the real value of (for details see 0, [l^). In the 
experiment, however, we can follow only finite number of measurements. Supposing that 
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after some measurements the sequence of l^^l becomes stable we can assume with high 
probabihty that this estimation value is in good agreement with the real one. 

For our analysis we have used fifty PE spectra where randomly chosen SN was added. 
Figures shows the evolution of estimated values which have to be proportional to the 
DOS value. In order to prove the SPSA algorithm we chose twelve control points in PE 
spectra at particular kinetic energies (points are marked on kinetic energy axis in Fig. 2) . The 
intensities at these points in PE spectra during step-by-step application of the algorithm 
are plotted in Fig. 3 with corresponding zoom for the last 10 steps (see inset). One can 
see that in spite of the overestimated large initial "guess" values, the algorithm process is 
almost stabilized at around 20th iteration. From iteration 46th we have the most stable 
estimations consequence. Figure 2 shows the result of the application of fifty steps of the 
SPSA algorithm (bottom spectrum). The evaluated spectrum is in good agreement with 
the one directly measured in the experiment, when the x-ray source was not activated (no 
SN noise). 

In conclusion, we have demonstrated that the application of the SPSA algorithm is an 
effective way of SN attenuation in the linear regression case. As an example we applied this 
algorithm to filtering the systematic noise in the PE spectra. It was found that a set of 50 
single-scan spectra is already enough to eliminate the systematic error. On the basis of these 
results we conclude that application of SPSA can be useful for analysis of a large variety of 
experimental data. 

This work was supported by the DAAD under grant A/05/58613 and the Deutsche 
Forschungsgemeinschaft SFB 463, TP B4 and B16. 
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Figure captions: 

Fig. 1. (a) Scheme of the PE experiment, where sample (1) is illuminated by two 
light sources, Hella and AlKa, electrons are analyzed by photoelectron spectrometer (2) 
and detector (3) registers the signal j„. (b) Layout of the present study using the SPSA 
algorithm for eliminating noises of unknown nature. 

Fig. 2. Experimental PE spectra of the valence band of W(llO) obtained with Hello; 
radiation without (open circles) and with (filled circles) systematic noise. Spectrum 

obtained after application of the SPSA algorithm to a series of 50 experimental single-scan 
spectra is shown by thin line. The shaded area in the bottom is systematic noise measured 
separately. Twelve control points used for demonstration of the convergence dynamic of 
the algorithm are matked with labels (1-12) on the kinetic energy axis. 

Fig. 3. Convergence of the SPSA algorithm: The estimated values [const ■ DOS{Ekin)] of 
the twelve control points marked in Fig. 2. 
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Fig. 3. 
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